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Abstract. We calculate the optimal solutions of the fully heterogeneous Von 
• rH . Neumann expansion problem with N processes and P goods in the limit N — > oo. 

This model provides an elementary description of the growth of a production economy 
i c*| in the long run. The system turns from a contracting to an expanding phase as N 

increases beyond P. The solution is characterized by a universal behavior, independent 
of the parameters of the disorder statistics. Associating technological innovation to an 
increase of TV, we find that while such an increase has a large positive impact on long 
term growth when N <C P, its effect on technologically advanced economies (N 3> P) 
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O !■ Introduction 

The dynamics in many complex systems involves a flux through components arranged 
in a heterogeneous network. Examples range from cell metabolism [1], food webs [2], 
supply networks [3], and river networks [4], to the way in which raw materials are 
combined and transformed into intermediate or consumption goods in an economy [5]. 



Mathematically, these phenomena can be cast into linear programming problems, for 
solving which efficient algorithms exist even for large instances. In each of these cases, 
however, it is important to understand whether the emerging global properties are due 
to the specific wiring of the input-output relationships or whether they are generic of 
large random realizations of any such problem. Put differently, the study of the typical 
properties of large random systems provides a useful "null hypothesis" against which 
specific results should be compared. The theoretical machinery for this kind of study 
is provided by the statistical mechanics of disordered systems and has already been 
applied to specific large random linear programming problems in the past [6,7]. 

One of the areas where such problems arise more frequently is economics. The study 
of typical properties of large random economies [8,9] is particularly relevant, first because 
it allows one to go beyond the simplistic framework of the so-called 'representative 
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agent', by accounting for the heterogeneity across agents and their interactions in many 
dimensions (technological capabilities, budgets, endowments, etc). Secondly because, 
contrary to biology, economic time scales are such that evolutionary design might not 
play a dominant role in shaping the (global properties of) interaction network. Hence, 
in real economies the latter might be closer to a large random instance than for e.g. 
metabolic networks. 

In this paper, we will study a simple model of economic growth, put forward by 
J. Von Neumann in the 1930's [5]. It describes economic growth as an autocatalytic 
process by which the outputs generated at any time are used either for consumption or 
as inputs for production at the later stage. This model has been widely studied and 
plays a central role in economic theory [10-13], as it forms the backbone of more refined 
models providing the key insights for understanding growth in the long run J. Our aim 
is that of characterizing the growth properties in terms of the underlying structural 
complexity of the production activity. More precisely, we shall compute the maximal 
growth rate of the economy as a function of the ratio between the number of production 
processes and the number of goods, and of the parameters of the distribution of input- 
output matrices. We shall also compute the number of active production processes and 
of "intermediate" goods, whose output is used entirely for further production. These 
results shed light on the way in which growth is affected by technological innovation, 
namely by an enrichment of the repertoire of available technologies, and in turn how 
this affects the activity levels. 

In the rest of the paper, we shall first introduce the model, then present the 
statistical mechanics approach and finally discuss the results. 

2. The model 

In somewhat simplified terms, Von Neumann's expanding model may be presented as 
follows. One considers an economy with P commodities (labeled /i) and N technologies 
(labeled i), each of which can be operated at a non-negative scale Si > and is 
characterized by an output vector ai = {af} and by an input vector bi = {of}, such 
that Sitf (respectively S^frf ) denotes the units of commodity ji produced (respectively 
used) by process i when run at scale S^. It is assumed that input/output vectors are 
fixed in time and that operation scales are the degrees of freedom to be set, for instance, 
by firms. At time (or period) t, the economy is characterized by an aggregate input 
and output vector for each commodity, J M (t) = J2iSi(t)b% and 0^{t) = J2i^i(' t ) a i 
respectively. Part of the latter will be used as the input at period t + 1 whereas the rest, 
namely 

C(t) = 0»(t) - J"(t + 1) (1) 

| Models of economic growth address the issue of maximizing discounted welfare over the evolution 
paths. Turnpike theorems [14] show that optimal paths overlap significantly with the paths of maximal 
expansion described by Von Neumann's model. 
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is consumed at time t. In absence of external sources, a necessary condition is that 
inputs at any time do not exceed the outputs at the previous time, i.e. one must have 
C^{i) > for all p at all times. In this way, the model describes a closed economy which 
is able to provide the society with all commodities without relying on external sources. 
Modern economic growth theories introduce a value for the stream of consumption C^{t) 
for all t and p - usually by postulating a utility function and a discount factor - and look 
for optimal growth paths {Si(t), t > 0}f =1 , as a function of some initial condition J M (0). 
Von Neumann's model instead focuses on the simpler issue of studying the feasibility of 
paths with a constant rate - i.e. such that I^(t + 1) = pl^(t) with p > a constant - 
and, in particular, on computing the highest feasible growth rate. These two problems 
are related because, under generic conditions, the optimal path coincides with that of 
maximal expansion apart from an initial transient [14]. This is why Von Neumann's 
model is relevant for long run properties of models of economic growth. For paths with 
constant expansion rate, the scales of production have the form Si(t) = Sip 1 and likewise 
C^it) = c^p 1 . The (technological) expansion problem then amounts to calculating the 
maximum p > such that a configuration s = {sj > 0} satisfying the condition 



exists [15,16]. In such a configuration the aggregate output of each commodity is at least 
p times its aggregate input. If the maximum p, which we denote by p*, is larger than 
1 the economy is 'expanding', whereas it is 'contracting' for p* < 1. It is a rigorously 
established fact that if af > and > for all i and p, p* exists (see [15] for a simple 
proof). On the other hand, the actual value of p* is expected to depend on the input 
and output matrices. Intuitively, p* should increase with the number N of technologies 
and decrease when the economy is required to produce a larger number P of goods. 

3. Statistical mechanics of large random instances 

In this work we study a fully heterogeneous version of above problem with technologies 
different from each other. We focus on random instances where and 6f are quenched 
random variables drawn from a certain probability distribution. More specifically, we 
shall consider the pair (af , bf ) as independent and identically distributed for each i 
and p. To begin with, let us first simplify the problem by writing = a(l + af) 
and fef = 6(1 + /3f ), where a and b are positive constants while af , /3f are zero-average 
quenched random variables. Inserting these into (2) one easily sees that to leading order 
(in N) p* is given by the ratio a/b of the average output and average input coefficients. 
In particular, the leading part of p does not depend on the structure of the input output 
matrices. The non trivial aspects of the problem are related to the corrections to the 
leading part. We therefore write the growth rate as 
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so that (2) becomes 
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The problem thus reduces to that of finding the largest value g* of g for which it is 
possible to find coefficients {sj > 0} satisfying (4). 

This issue can be tackled in the limit iV — > oo employing a standard technique 
originally due to Gardner [17], which allows to derive the behavior of g* as a function of 
the control parameter n = lim^v^oo N/P. The volume of configuration space occupied 
by micro-states satisfying (2) at fixed disorder is given by 

1 
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where we introduced a linear constraint £V Sj 
solutions for A" — > oo reads instead 



N. The typical volume occupied by 



Vtyp(g) ~ e 
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where the last equality contains the replica trick and the over-bar stands for an average 
over the quenched disorder, that is over the vectors af and /5f . As usual, the leading 
contributions to v typ (g) i n t ne limit A" — > oo come from the first two moments of the 
distribution of af and /3f . Given that af and /?f have zero mean, the only property 
of the disorder distribution which enters the final result is the covariance matrix of the 
disorder. Actually, the explicit calculation shows that g* only depends on the parameter 

*=(<*?- W (7) 

To make a concrete example, consider the input (output) matrices where bf = b 
(af = a) for B values of ji and bf — (af = 0) otherwise. Then it is easy to see 
that b = bB/N (a = aA/N), (/3f) 2 = N/B - 1 ((af) 2 = JV/j4 - 1) and = so 

that k = N/A + N/B — 2. In particular, the case where outputs and inputs are few 
corresponds to k 1. 

After expressing the ^-functions via their integral representations and carrying out 
the disorder average one finds 



[V a A9)] r = / Ji(q)J2(q)dq 



(8) 



where q is a vector of order parameters {qw}\<£i representing the overlaps between the 
configurations in different replicas, qee> = (1/N) ^2 i s i £S iJ p, an d 
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The space of solutions {sj} is a convex set, hence we expect the replica-symmetric 
approximation to be exact in this case. We therefore evaluate (9) and (10) imposing 
the Ansatz 
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qw = q + X$u>, Ru> = — g — 5 «'~ r2 ' mt = m. (11) 
Putting things together, Eq. (6) yields 

VtyM = extr Q:X [Fi(q, x) + extr /3jTim F 2 (g, x, P, t, m)\ (12) 
where exti x f(x) denotes the operation of taking the extremum of f(x), and 

1 / f°° dc + 

n \ ° g Jo V^kx 



Fi = - (\og J - 1 ==e ^ > (13) 



1 

n 



log 



2 jWx- 

F 2 = m+ 1 -(5{ X + q)- \ X r 2 + ^log ^ ds e -(™+fr).-^/2^ (14) 

The brackets (. . .) c = f°° -%=e~^ 2 ^ 2 ■ ■ ■ stand for an average over the unit variance 
Gaussian random variable $ ) . The problem can in principle be solved in a straightforward 
way, by analyzing the saddle point equations for any value of g. We expect, however 
that as g — > g* the typical volume V typ shrinks until just one solution remains (modulo 
re-scalings of the Sj's). Hence x? which describes the fluctuation Sj among feasible 
solutions, should also vanish as g — > Hence the conditions g = g* and x = are 
equivalent. When x — ► the integral in (13) can be calculated by steepest descent. The 
distribution of c M in Eq. (4) can be read off Eq. (13) and it has the form 



p(c) = (f) 5(c) + 9(c)e 2 * k (15) 



where 



*=H 1+erf m) (16) 

is the fraction of commodities that are not consumed (namely for which c M = 0) at 
g = g*. These commodities are uniquely used as intermediate goods in the production 
process. A further important observation is that Fi and hence v typ depend on g* only 
through the combination g*/y/k. This completely characterizes the dependence of the 
maximal growth rate on the parameters of the disorder distribution. 

If as g — > g* the volume of feasible solutions shrinks to zero, the integral on s in F 2 
must ultimately be dominated by a single value. This is consistent with a 1/x divergence 
of the parameters @, r and m. Hence it is convenient to introduce the variables 

b = xP, t = xr, z = -m/r (17) 
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which remain finite in the limit x ~ * an d turn out (after some algebra) to be given by 
the solution of 



6=-<^-0^-0> € - ( 18 ) 
fc(s-flfl(s-fl) g 

<(s-0*(*-0> € 

In analogy with what we did for c M , it is possible to compute the distribution of Sj. In 
particular the fraction of inactive technologies (sj = 0) is found to be 



^»=2 erf nv!j' (l9) 

Eqs. (18) can be solved numerically to the desired accuracy to yield b, t and z as a 
function of g. We are left with two saddle point conditions, for q and Xi respectively. 
The latter reads 

t 2 = l^ + 9/Vkq) 2 e^ + g/^Vq) ^ (20) 

The saddle point equation for q requires a bit more work. Indeed for x ~^ the leading 
contributions of F\ and F<i are of order 1/x but they cancel exactly. One must therefore 
consider the next-to-leading-order correction, of order logx- We note, in passing, that 
this is consistent with the volume of solutions vanishing as i>typ(<7) ~ X lN as 9 ~^ 9* ■ 
After some algebra, the final equation takes the particularly simple form 

o = n(l-^ o ). (21) 

This condition implies that the number of active processes equals that of intermediate 
commodities at g*. Noting that for any \x such that & = we have a linear equation 
for the scales > 0, we see also that (21) simply corresponds to the requirement that 
the number of equations should match the number of variables. 

Eqs. (18), (20) and (21) allow us to compute g* as a function of n and k. As 
already noticed, the dependence g* oc \fk can be read off directly from the equations, 
hence g* / \/k is an universal function of n, independent of the details of the distribution 
of input-output coefficients (as long as they are i.i.d.). Actually, since k enters the 
equations only through the combination g*/ y/k, and this is a function of n, then the 
solution itself will be universal, i.e. independent of k. 

Fig. 1 reports the rescaled growth rate g*/ y/kn as a function of n. This line 
separates the region of feasible solutions with growth rates g < g* from the region of 
unfeasible solutions, g* crosses the line g* — at n — 1, as can be checked explicitly. 
Indeed, by Eq. (16), g* = corresponds to a situation where half of the goods are not 
consumed (0 O = 1/2) while Eq. (20) yields t 2 = q/(2n), which is consistent with the 
other equations for z — 0, i.e. n — 1. At this same point, half of the technologies are 
operated (ip = 1/2). This means that, when there are more technologies than goods 




Figure 1. Behavior of g*/Vkn vs n. Inset: 0o and ipo (related by (21)) vs n. 

(n > 1) a growth rate higher than that of the ratio a/6 of average output and input 
coefficients is achievable. The growth rate is instead smaller than a/b when n < 1. 

The inset of Fig. 1 shows the fraction of inactive processes ipo and that of 
intermediate commodities 0o at function of n. For what we said earlier, these 

are universal functions of n independent of the details of the disorder distribution. Both 
0o and ip tend to one when n increases. 

4. Discussion 

In summary, we have studied the typical properties of the Von Neumann expanding 
model in the case where input-output matrices have i.i.d. random elements. We 
characterize the region of feasible expansion paths and focus on the solutions at its 
boundary, which correspond to the paths of maximal expansion. We uncover an 
universal behavior, independent of the details of the distribution, of the relevant 
quantities. In particular we find that as the number N of technologies grows, the 
optimal growth rate increases, but the economy becomes more and more selective both 
on the processes which are used and on the goods which are consumed. 

At a purely speculative level, our results allow us to draw conclusions on how 
long term growth on the maximal expansion path will be affected by technological 
innovation. The latter, defined as the introduction of new designs, i.e. new feasible 
ways of combining inputs to produce desirable outputs [18] would just correspond, in 
our simplified world, to an increase in the number N of transformation processes which 
the economy has at its disposal. By Eq. (3) the change in the growth rate is related 
to the change in g*/y/n, which is plotted in Fig. 1. This shows that when n is small 
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(n < 1) 

Sn 

9 ^ n*l 2 ^P 

i.e. an increase in N can have a large positive impact on long term growth. For 
technologically mature economies (n ^> 1) instead, g* / ' y/n increases much more slowly, 
hence technological innovation has much smaller effect on long term growth. These 
insights are remarkably similar to those derived in [9] for model of general economic 
equilibrium. 

There are several directions in which the present work could be extended. First, 
it would be desirable to study more realistic ensembles of input-output matrices, or 
more detailed models of economic growth. In particular, realistic technologies only have 
a finite number of inputs and outputs, which would call for the use of techniques for 
disordered systems with diluted interactions. It would also be interesting to generalize 
this study to the case where the input-output transformation is subject to stochasticity. 
A further natural extension of this approach concerns the analysis of typical properties 
of large random metabolic [1] or supply networks [3], or of food webs [2]. 
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